Search results for "Inter-rater reliability"

Reliability and validity of the German version of the European Addiction Severity Index (EuropASI).

2001

This study provides data on the psychometric characteristics of the German version of the European Addiction Severity Index (EuropASI). The ASI is a frequently used clinical and research instrument that measures problem severity among people with substance dependence.The German ASI was used in a sample of 112 consecutively admitted male psychiatric inpatients seeking treatment for severe alcohol problems. The conceptual structure of the German ASI subscales was investigated by analyzing the intercorrelations of the severity ratings and composite scores. Internal consistency, interrater reliability and concurrent validity in terms of correlations with other assessment instruments were evalua…

Do neurologists agree in diagnosing drug resistance in adults with focal epilepsy?

2019

Objective: To evaluate interrater agreement in categorizing treatment outcomes and drug responsiveness status according to the International League Against Epilepsy (ILAE) definition of drug-resistant epilepsy. Methods: A total of 1053 adults with focal epilepsy considered by the investigators to meet ILAE criteria for drug resistance were enrolled consecutively at 43 centers and followed up prospectively for 18-34 months. Treatment outcomes for all antiepileptic drugs (AEDs) used up to enrollment (retrospective assessment), and on an AED newly introduced at enrollment, were categorized by individual investigators and by 2 rotating members of a 16-member expert panel (EP) that reviewed the …

Validation of the German Version of the Quality of Dying and Death Questionnaire for Health Professionals

2016

Purpose: To validate the Quality of Dying and Death (QoDD) instrument for health professionals (QoDD-D-MA) and to test its feasibility in 2 German palliative care units (PCUs). Methods: The QoDD was translated from English to German and then retranslated following European Organisation for Research and Treatment of Cancer (EORTC) guidelines. Data were collected in 2 German PCUs to calculate aspects of validity and reliability. Results: Mean total score was 83.05 (range 49-100; N = 232). The QoDD-D-MA showed satisfactory psychometric properties, Cronbach α = .830; interrater reliability r = .245 ( P < .01). The QoDD-D-MA was independent of patients’ demographic and clinical aspects. Some …

Improvement of inter-rater reliability of PANSS items and subscales by a standardized rater training.

1998

The present evaluation focused on the inter-rater reliability of single items and subscales of the Positive and Negative Syndrome Scale (PANSS) before and after a standardized rater training. The results of two independent studies comprising n=23 (study I) and n=12 (study II) psychiatrists and videotaped interviews with schizophrenic patients were analysed. Chance-corrected coefficients of rating agreement with expert standards (weighted kappa) were computed for single items and subscales of the PANSS. The results clearly demonstrate the importance of rater trainings. After three training sessions, 90% of the PANSS items reached an acceptable level of reliability (kappa(w)>0.40) in both eva…

The Calgary Depression Rating Scale for Schizophrenia: development and interrater reliability of a German version (CDSS-G)

1999

A German version of the Calgary Depression Rating Scale for Schizophrenia (CDSS-G) approved by the author of the original scale is presented comprising a semi-structured interview for 9 items to sensitively and specifically assess depression in schizophrenia and related disorders. The process of translation is outlined and the finally derived CDSS-G was investigated with respect to interrater reliability in three studies. To keep comparability with the CDSS source version a standard procedure was used. Two trained raters jointly assessed ten schizophrenic patients (study I). In a second study, videotapes with the CDSS-G were presented to clinically inexperienced raters (study II, N = 14/15)…

Standardized rater training for the Hamilton Depression Rating Scale (HAMD-17) in psychiatric novices.

2003

Abstract Background: Despite the long and widespread use of the Hamilton Depression Rating Scale (HAMD), standardized reliability studies in inexperienced raters are not available. Methods: Rater training was carried using three videotaped interviews with depressed patients in 21 psychiatric novices who had negligible previous experience with the HAMD. Chance-corrected coefficients of rating agreement with expert standards (weighted κ , ICC) were computed for single items and the total score of the HAMD. Results: The results demonstrate sufficiently high interrater reliability ( κ >0.60) for most of the HAMD items and the total score (ICC=0.57–0.73). Three standardized HAMD training session…

Evaluation of standardized rater training for the Positive and Negative Syndrome Scale (PANSS)

1998

The Positive and Negative Syndrome Scale (PANSS) is employed increasingly for the evaluation of therapeutic outcome in studies on schizophrenia. Rater training is important to improve the concordance and accuracy of ratings; however, there are no established guidelines for carrying out such training. We conducted rater training, under clinical conditions, of psychiatrists and clinical psychologists who were rather unfamiliar with the PANSS. Based on videotapes of PANSS interviews, all participants were trained during five successive standardized weekly sessions. The results were analyzed with respect to conventional criteria of concordance with standard expert ratings and interrater reliabi…

Relationship of Psychiatric Experience and Interrater Reliability in Assessment of Negative Symptoms

1999

Towards an international language for incontinence-associated dermatitis (IAD): design and evaluation of psychometric properties of the Ghent Global …

2018

Background Incontinence-associated dermatitis (IAD) is a specific type of irritant contact dermatitis with different levels of severity. An internationally accepted instrument to assess the severity of IAD in adults with established diagnostic accuracy, agreement, and reliability is needed to support clinical practice and research.Objectives To design and psychometrically evaluate the Ghent Global IAD Categorisation Tool (GLOBIAD).Methods The design was based on expert consultation using a three-round Delphi procedure with 34 experts from 13 countries. The instrument was tested using IAD photographs reflecting different severity levels in a sample of 823 health professionals in 30 countries…

Experts' assessment of probability and level of pesticide exposure in agricultural workers.

2000

The occupational history of the parents of 261 infants with congenital malformations and 261 matched controls was collected. During the relevant time period before the birth of their child, 183 parents were involved in agricultural activities, 49% of them having directly applied pesticides. Two experts assessed the probability and the level of exposure to each quoted pesticide (582 observations) by using 4-point scales. Interrater agreement was estimated. Kappa-weighted values for probability and level of exposure were, respectively, kappa = 0.36 and kappa = 0.39. In the analysis of some categories of exposure (non-applicators, herbicides) very low interrater agreement was observed. In epid…